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(54) Image data processing and encrypting apparatus. 

(57) An image processing apparatus separates in- 
put image data into low resolution image data 
and one or more auxiliary image data for inter- 
polating the low resolution image data, and 
encrypts at least one of the separated auxiliary 
image data. 

An image processing apparatus for separat- 
ing input image data into low resolution image 
data and at least one auxiliary image data for 
interpolating the low resolution image data and 
decoding the image data with at least one of the 
auxiliary image data being encrypted decrypts 
the encrypted auxiliary image data and synth- 
esizes the low resolution image data with the 
auxiliary image data. 
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The present Invention relates to an Image processing apparatus, and more partially to the encryption 
of image date^ ^ ^ ^ ^ cont i gu ratlon of a prior art Image encoding apparatus having an en- 

s ^ y ti° Q n 2 U 2SI"b block diagram of an image decoding apparatus for decoding the image data .needed by 

lh6 T^^WW^ shown in Fig- 1. numeral 11Q denotes a high resolution analog video signal 
(hereinafter referred to as an HD signal), which. In the present example, has the number of scan lines of 1 ,050 
and a frame frequency of 30 Hz. Relative to the HD signal, a video signal of an ordinary resolution having the 
10 number of scan lines of 525. a frame frequency of 30 Hz and the number of pixels of fi58 Is referred to as an 

SD signal^ ^ ^^tfw drcu(t 112 samples the video signal 110 at a sampling frequency of 54-054 MHz to 
convert it to a digital signal. By virtue of the sampling frequency, the number of pixels per line of the digital HD 
signal is 1 .71 6. A high resolution (HD)/ordinary resolution (SD) conversion circuit 114 reduces the number of 
,5 pixels to one half in both vertical direction and horizontal direction to output a video signal of the ordinary re- 
solution having the number of scan lines of 525, the frame frequency of 30 Hz and the number of pixels per 

llf19 An^ncodlng circuit 11 6 efficiently encodes the digital SD signal outputted from the conversion circuit 114 
by an encoding scheme which is a combination of motion compensated adaptive prediction and DOT. A de- 

20 coding circuit 118 decodes the encoded signal outputted from the decoded circuit 116 to reproduce an SD sig- 
nal. An SD/HD conversion signal 120 interpolates pixels to the output video data from the decoding circuit 118 
by a factor of two In both vertical direction and horizontal direction to convert it to an HD signal. Namely, the 
SD/HD conversion circuit 120 outputs a signal corresponding to the high resolution video signal having the 
number of scan lines of 1 ,050, the number of pixels per lipe of 1 ,716 and the frame frequency of 30 Hz. 

25 A subtracter 122 subtracts the output of the SD/HD conversion circuit 120 from the output of the A/D con- 

version circuit 112 for each pixel. The output of the subtracter 122 is referred to as an auxiliary video signal. 
An encoding circuit 124 encodes the output of the subtracter 122 in the same encoding scheme as that for the 
encoding circuit 116. 

A multiplexing circuit 126 multiplexes the encoded data (the encoded SD signal) outputted from the en- 
30 coding circuit 116 and the encoded data (the encoded auxiliary video signal) outputted from the encoding circuit 
1 24 and outputs It to an encryption circuit 128. The encryption circuit 128 encrypts the output of the multiplexing 
circuit 126 in accordance with an encryption key signal of an encryption key output circuit 130. and an output 
unit 132 outputs the encrypted data outputted from the encryption circuit 126 to a transmission line. As de- 
scribed above, the transmission line may be a communication line or a recording medium. 
ss The encryption is briefly explained with reference to Figs. 3 and 4. Following encryption techniques are 

available. 

Fig. 3 shows a flow chart of the encryption by the US Data Encryption Standard (DES) published in the 
FIPS Publication 46 dated January 1 5, 1 977, and Fig. 4 shows a function of the encryption of Fig. 3. The data 
encryption algorithm of the DES has been published as the "Data Encryption Standard 11 as described above. 
40 Referring to Figs, 3 and 4, the DES will be explained. 

The DES handles block encryption to binary data comprising 0's and Vs. In the DES, the binary data is 
grouped Into 64-bit blocks and the transposition and the replacement are repeated for each block to encrypt 
it. An encryption key is a 64-bit signal, of which 8 bits are chock bits for detecting an error. Thus, a 5S-plt en- 
cryption key is actually effective. The replacement of the digit Is controlled by the encryption key in each cycle. 
45 Fig. 3 shows a n encryption process of the DES. Fig. 4 shows a function fK(R) which is a heart of the encryption. 

As shown In Fig. 3, a 64-bit plain text Is first transposlt|oned. This Is a fixed transposition independent from 
the encryption key. Then, the 64 bits are divided into a left half U and a right half Ro- Then, the following op- 
erations are repeated over the 16 stages: 

Ln m R n - t 

50 - R n *= L*- i + *Kn(*A- i) CD 

where + represents a sum of mode 2 for each bit, L n and R n represent the left half 32 bits and the nght half 32 
bit, respectively, at the end of the operation for the n-th stage, and K n is generated from the encryption key 
as shown in the right side of Fig. 3. In Fig. 12, s^,.— s 16 are 1 or 2. 

Condensed transposition Is defined as the transposition excluding some of the input In Fig. 3, 8 bits out 
55 of the 56 input b|ts are excluded so that an output comprises 48 bits. The condensed transposition is irrevocable 
conversion so that the Input cannot be perfectly reproduced from the output This serves to make the estima- 
tion of the encryption key difficult 

Referring to Fig. 4, the function fK(R) in Fig. 3 is specifically explained. In Fig. 4. to generate the function 
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It is thus seen that and R^i can be calculated from U and R n . 

The calculation of the formula (1) is repeated 1 6 times and when L 16 and R,« are determined, they are 
f inally transpositioned again and the encryption is terminated. 

In a decoding apparatus shown in Fig. 2. a transmission data, input unit 140 receives the data from the 
transmission line and supplies It to a decryption circuit 142. The decryption circuit 142 decrypts it by utilizing 
the encryption key signal outputted from the encryption key output circuit 144. in order for the decryption to 
be correctly done, the exactly same encryption key as that outputted from the encryption key output circuit 
130 used in the encoding apparatus (see Fig. 1) should be used. 

The decryption is substantially a reverse operation to the encryption. Briefly, the process proceeds from 
the bottom to the top In Fig. 3. First a reverse transposition to the last transposition ip the encryption is made, 
and and U 1 are determined from the formula (2). and when R<, and L* are determined, a reverse trans- 
position to the first transposition in the encryption is made. In this manner, the original 64 bits are reproduced. 
In order to decrypt the DES encrypted text, there has been no known method other than examining the keys 
one by one. Assuming that one microsecond is needed to examine if one key is correct one or not 2,283 years 
will be needed to examine all of 2 M keys. 

The transmission data decrypted by the decryption circuit 142 Is separated by a separation circuit 146 to 
encoded data of the SD signal and encoded data of the auxiliary video signal, which are supplied to decoding 
circuits 148 and 150. respectively. The decoding circuit 148 outputs the reproduced SD signal and the decoding 
circuit 150 output the reproduced auxiliary video signal. 

An SD A/D conversion circuit 152 converts the digital SD signal outputted from the decoding circuit 148 
to an analog signal. The output of the SD A/D conversion circuit 152 is an analog video signal having the number 
of scan lines of S25 and the frame frequency of 30 Hz. This video signal is applied to a monitor device of an 
ordinary resolution to display the Image, 

An SD/HD conversion circuit 154 converts the digital SD signal outputted from the decoding circuit 148 
to a digital HD signal in the same process as that of the SD/HD conversion circuit 120. An adder 156 adds the 
output of the decoding circuit 150 and the output of the sp/HD conversion circuit 154. The output of the adder 
156 Is a video signal corresponding to the high resolution video signal. An HD D/Aconvemlon cjrcuit 158 con- 
verts the digital output of the adder 1 56 to en analog signal. The output of the HD DM converter 158 is a video 
signal having the number of scan lines of 1 .050 and the frame frequency of 30 Hz. The video signal is applied 
to a high resolution monitor to display the Image. 

The above prior art video signal encoding and decoding apparatus has a problem in that the video signal 
cannot be reproduced for those who do not have the encryption key, for both the low resolution video signal 
and the high resolution video signal. 

There Is a demand that charges to users are discriminated between the low resolution display device hav- 
ing the number of scan lines of 525 and the high resolution display device having the number of scan lines of 
1 ,050. for the same content but the prior art apparatus does not meet the requirement, 

in a first aspect the present Invention provides an image processing apparatus which permits the repro- 
duction as usual for an image having a lower resolution than a predetermined level and permits the reproduc- 
tion of an Image having a higher resolution by conducting a predetermined process. 

In one embodiment the image processing apparatus comprises separation means for separating input Im- 
age data into low resolution image data and on© or more auxiliary image data for interpolating the low resolution 
image data, and encryption means for encrypting at least one auxiliary data. 
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In another preferred embodiment, the image processing apparatus for separating the mput Imago data 
Into the low resolution image data and the one ormore auxiliary Image data for interpolating the low resolution 
image data and decoding the Image data having at least one auxiliary image data encrypted compnces de- 
cryption means for decrypting the encrypted auxiliary Image data, and synthesizat.on means for synthesizing 
the low resolution image data and the auxiliary Image data. 

Other aspects features and advantages of the invention will become apparent from the following detailed 
description taken In conjunction with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 shows a block diagram of a prior art image encoding apparatus. 
Rg. 2 shows a block diagram of a prior art image decoding apparatus, 
Fig. 3 shows a flow of prior art encryption. 
Fig, 4 shows a flow of prior art decryption. 
15 Fig, 5 shows a block diagram of a configuration of one embodiment of an imago encoding apparatus of 

the present invention, 

Fig. 8 shows a block diagram of a configuration of an embodiment of an image decoding apparatus of the 
present invention. 

Fig. 7 shows a block diagram of a modif ied portion of a configuration of a modified embodiment of Fig. 6, 
20 Fig. 0 shows a block diagram of a modified portion of a modified embodiment of Fig. 6, 

Fig. 9 shows a block diagram of a configuration of a second embodiment of the image encoding apparatus 
of the present Invention. 

Fig. 10 shows a block diagram of a configuration of a second embodiment of the image decoding apparatus 
of the present invention. 
25 Fig, 11 Illustrates band division of a space frequency, 

Fig, 12 shows a block diagram of a configuration of a modified portion of a modified embodiment of Fig. 

Fig- 13 shows a block diagram of a configuration of a modified portion of a modified embodiment of Fig. 
10, 

Fig. 14 shows a block diagram of a specific encoding circuit of the embodiment, and 
Fig. 15 shows a block diagram of a specific decoding circuit of the embodiment. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

3s Fig. 5 shows a block diagram of a configuration of one embodiment of the encoding apparatus of the pres- 

ent Invention, and Fig. 6 shows a block diagram of a configuration of the decoding apparatus. 

The encoding apparatus shown in Fig. 5 is first explained. Numeral 10 denotes a high resolution video 
signal having the number of scan lines of 1 ( 050 and the frame frequency of 30 Hz as the HD signal 110 does. 
Numeral 12 denotes an HD A/D conversion circuit for converting the video signal 10 to a digital signal, numeral 

40 14 denotes a high resolution (HD)/ordinary resolution (SD) conversion circultfor converting the digital HD sig- 
nal outputted from the HD A/D conversion circuit 12 to a video signal of the ordinary resolution, numeral 16 
denotes an encoding circuit for efficiently encoding the output of the conversion circuit 14, numeral 1 8 denotes 
a decoding circultfor decoding the output of the encoding circuit 16, numeral 20 denotes an SD/HD conversion 
circuit for interpolating the SD signal output of the decoding circuit 18 to convert it to an HD signal, numeral 

as 22 denotes a subtractor fbr subtracting the output of the SD/HD conversion circuit 20 from the output of the 
HD A/D conversion circuit 12 for each pixel, and numeral 24 denotes an encoding clrcuitfor encoding the output 
of the subtactor 22. The circuits 12-24 have the same functions as those of the circuits 112 - 124 of Fig. 1 
and operate in the some manner. 

Numeral 26 denotes an encryption circuit for encrypting the output of the encoding circuit 24 in accordance 

50 . with an encryption signal outputted from an encryption key output circuit 28. As the encryption technique, the 
one which complies with the DES standard Is used. 

Numeral 30 denotes a multiplexing circuit for multiplexing the output of the encoding circuit 16 and the en- 
cryption circuit 26. and numeral 32 denotes an output unit for outputtlng transmission data multiplexed by the 
multiplexing circuit 30 to a transmission line such as a communication line or a recording medium. 

55 The encoding apparatus shown in Fig. 5 Is explained. The operations of the circuits 12 - 24 are same as 

those of the prior art apparatus. Namely, the encoding circuit 1 B outputs the encoded data of the video signal 
derived by converting the HD signal 10 to the ordinary resolution, and the encoding circuit 24 outputs the en- 
coded data of the auxiliary video signal to reproduce the high resolution video signal from the transmission 
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video data of the ordinary resolution. In the present embodiment prior to the multiplexing of the both encoded 
data the output encoded data of the encoding circuit 24 is encrypted by the encryption circuit 26 by us.ng the 
encryption key signal outputtad from the encryption key output circuit 28 and it is applied to the multiplexing 

C, ™Ac2rdlngly. In the present embodiment, the multiplexing circuit 30 multiplexes the encoded data of the 
video signal of the ordinary resolution (the output of the encoding circuit 16) and the encoded data of the en- 
crypted auxiliary video signal and the outputunlt 32 outputs the output of the multiplexing circuit 30 to the trans- 
mission line. Accordingly, the video signal of the ordinary resolution la transmitted without encryption but the 
information for reproducing the high resolution video signal (auxiliary video signal) Is encrypted so that, in the 
receiving station, the high resolution video signal cannot be reproduced without the encryption key but the vid- 
eo signal of the ordinary resolution can be reproduced without the encryption key. 

The decoding apparatus shown in Fig. 6 is explained. Numeral 40 denotes a transmission data input unit 
for receiving data from the transmission line, numeral 42 denotes a separation circuit for separating a set 
stream from the transmission data input unit 40 to a portion related to the encoded data of the SD signal and 
15 a portion related to the encoded data of the auxiliary video signal, and numeral 44 denotes a decryption circuit 
for decrypting the encoded data of the auxiliary video signal from the separation circuit 42 by referencing the 
encryption key signal outputted from the encryption key output circuit 46. 

Numeral 48 denotes e decoding circuit for decoding the encoded data of the SD signal from the separation 
circuit 42, numeral 50 denotes a decoding circuit for decoding the encoded data of the auxiliary video signal 
from the decryption circuit 44, numeral 52 denotes an SD D/A conversion circuit for converting the digital SD 
signal outputted from the decoding circuit 48 to an analog signal, numeral 54 denotes an SD/HD conversion 
circuit for convening the digital SD signal outputted from the decoding circuit 48 to a digital HD signal In the 
same process as that of the SD/HD conversion circuit 20, numeral 56 denotes an adder for adding the output 
of the decoding circuit 50 to the output of the SD/HD conversion circuit 54, and numeral 58 denotes an HD 
25 D7A conversion circuit for converting the digital output of the Adder 56 to an analog signal. 

An operation of the decoding circuit shown In Fig. 6 Is explained. The transmission data input unit 40 re- 
ceives the data from the transmission line and supplies it to the separation circuit 42. and the separation circuit 
42 separates it to a portion related to the encoded data of the SD signal and a portion related to the encoded 
data of the encrypted auxiliary video signal and supplies the former to the decoding circuit 48 and the latter 
30 to the decryption circuit 44. The decryption circuit 44 decrypts the encryption applied to the encoded data of 
the auxiliary video signal by using the same encryption key signal outputted from the encryption key output 
circuit 46 as the encryption key signal outputted from the encryption key output circuit 28 of the encoding circuit 
(Fig. 1). The encoded data of the auxiliary video signal decrypted by the decryption circuit 44 is applied to the 
decoding circuit 50 and decoded thereby. 
35 Thus, the decoding circuit 46 outputs the reproduced digital SD signal and the decoding circuit 50 outputs 

the reproduced digital auxiliary video signal. 

The SD D/A conversion circuit 52 converts the digital SD signal outputted from the decoding circuit 48 to 
an analog signal. The SD D/A conversion circuit 52 may be an analog signal having the number of scan lines 
of 525 and the frame frequency of 30 Hz and the video signal is applied to a monitor device of the ordinary 
40 resolution to display the image. 

The SD/HD conversion circuit 54 converts the digital SD signal outputted from the decoding circuit 48 to 
a digital signal in the same process as that of the SD/HD conversion circuit 120. The adder 56 adds the output 
of the decoding circuit 50 to the output of the SD/HD conversion circuit 54 for each pixel. The output of the 
adder 56 (a a video signal corresponding to the high resolution video signal. The HD D/A conversion circuit 58 
46 converts the digital output of the adder 56 to an analog signal. The output of the HD D/A conversion circuit 58 
is a high resolution video signal having the number of scan lines of 1,050 and the frame frequency of 30 Hz 
and It may be applied to a high resolution monitor to display the Image. 

In the decoding apparatus shown in Fig. 6, without the encryption key or if the encryption key is not correct 
(hereinafter collectively referred to as without key or no key state), the decryption circuit 44 outputs quite an 
so . unstable dam pattern so that the output of the HD D/A conversion circuit 58 is also unstable and an unstable 
pattern 9uch as a noise image Is displayed on the screen of the display device such as a CRT. 

Alternatively, a fixed image may be displayed on the high resolution monitor screen in the no key state. 
Figs, 7 and 8 show portions of block diagrams of such modified encoding apparatus. The like elements in Figs. 
7 and 8 are designated by like numerals. 
55 |n Fig. 7. a switch 60 Is provided between the decoding circuit 50 and the adder 56, and when the no key 

state (no input of the encryption key signal) is detected by the decryption circuit 44, the switch 60 is set tp '0' by 
the detection output so that 'O* is applied to the adder 56. When the correct encryption key is inputted to the 
decryption circuit 44", the decryption circuit 44' connects the switch 60 to the output of the decoding circuit 50. 
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In Flo 8 a switch 62 is provided between the adder 56 and the HD D7A conversion circuit 58 bo that in 
the no key stete a predetermined level is Inputted to the HD D/A conversion circuit 58. The switch 62 normally 
selects the output of the adder 56, and when the decryption circuit 44' the no key state (no input of the en- 
cryption key signal), the switch is set to the predetermined level Input In this manner, when the correct input 
is present the high resolution video signal le outputted but in the no key state, the predetermined level signal 
Is outputted and an image corresponding to the predetermined level is displayed on the monitor screen. 

In Figs 7 and 8 the switches 80 and 62 are illustrated to facilitate the understanding although It is apparent 
that the function of such switches 60 and 82 may be Incorporated in the decoding circuit 50 and/or HD A/D 
conversion circuit 58. Alternatively, the output of the decodinfl circuit 50 or the HD D/A conversion circuit may 
be forced to a predetermined level (for example, zero output) in response to the detection of the no key state 
by the decryption circuit 44. 

tn Figs. 7 and 8. the no key state is detected by the decryption circuit 44 although it may be detected by 
error code detection or error correction process. 

Asecond embodiment of the present invention which is applied to e system in which the image Information 
is transmitted by the band division by the space frequency is now explained. Fig. 9 shows a block diagram of 
a configuration of an encoding apparatus thereof, and Fig. 10 shows a block diagram of a configuration of a 
decoding apparatus. Fig, 11 illustrates the band division of the space frequency. 

Numeral 210 denotes an analog HD signal to be encoded. In the present embodiment, It Is a video signal 
having the number of acan lines of 1 ,050 and the frame frequency of 30 Hz. An HD A/D conversion circuit 212 
samples the analog HD signal at ^sampling frequency of 54.054 MHz to convert it to a digital signal. The num- 
ber of pixels per line of the sampled HD signal is 1.716. 

The output of the HD A/D conversion circuit 212 ie applied to band division filters 214 and 216 and divided 
by the filters 214 and 216 to a low frequency component and a high frequency component at a horizontal fre- 
quency and the number of pixels is reduced to one half, respectively. 

The output of the band division filter 214 is a low resolution component of the horizontal frequency, which 
Is further separated into a low frequency component and a high frequency component at a vertical frequency 
by band dMslon filters 218 and 220 to reduce the number of pixels to one half. Similarly, the band division 
filters 222 and 224 separates the output of the band division filter 21 6 (the high resolution component at the 
horizontal frequency) into a low frequency component and a high frequency component at the vertical f requen- 
so cy to reduce the number of pixels to one half. 

In this manner, the high resolution video signal having 1.716 pixels in the horizontal direction and 1.024 
pixels in the vertical direction is separated Into an LL signel (the output of the band division filter 2 16), an LH 
signal (the output of the band division filter 220), an HL signal (the output of the band dh/ision filter 222) and 
an HH signal (the output of the band division filter 224) having one half of the total number of pixels In the hor- 
izontal direction and the vertlcel direction, as shown in Fig, 11. Since only the LLslgnal has the low-pass data 
in both the horizontal direction and the vertical direction, It Is the video information which can be reproduced 
for display as the Image and corresponds to the video signal of the ordinary resolution having the number of 
scan lines of 525. the frame frequency of 30 Hz and the number of pixels per line of 858. On the other hand, 
since the LH signal, the HLsignal and the HH signal are high-pass data, they cannot be displayed as the image 
40 as they are and they are the auxiliary video signals which form the high resolution video signal in cooperation 
with the LL signal. 

The encoding circuit 226 efficiently encodes the output of the band division filter 218 (LL signal) by an 
encoding scheme which is a combination of the motion compensated adaptive prediction known ae the CCIR 
Recommendation 723 and the PCT. Encoding circuit 228, 230 end 232 efficiently encode the outputs of the 

46 band division filters 220. 222 and 224 (LH signal, HL signal and HH signal), respectively, by a combination of 
the DPCM and a zero run length encoded and variable length code. The outputs of the encoding circuits 228 
- 232 are multiplexed by a multiplexing circuit 234. An encryption circuit 236 encrypts the output of the multi- 
plexing circuit 234 by using the encryption key outputted from the encryption key output circuit 238 in accor- 
dance with tha encryption technique of the DES standard described above. 

50 ~ The multiplexing circuit 240 multiplexes the output of the encoding circuit 226 and the output of tha en- 
cryption circuit 236 and the output thereof is outputted to the transmission line by the output unit 242. 

In the decoding apparatus shown in Fig. 1 0, the transmission data input unit 250 receives the transmission 
data from the transmission line and applies it to the separation circuit 252. The separation circuit 252 separates 
it into a portion related to the encoded data of the LL signal and a portion related to the other LH. HL and HH 

55 signals, and applies the former to the decoding circuit 254 end the latter to the decryption circuit 256. The de- 
cryption circuit 256 decrypts the encoded data of the LH. HL and HH signals by using the encryption key signal 
outputted from the encryption key output circuit 258. In order to correctly decrypt it, the encryption key should 
be same as that used for encoding the encryption key siQnal. 
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The separation circuit 260 separates the output of the decryption circuit 256 to the encoded data of the 
LH signal, the encoded data of the HL signal and the encoded dqta of the HH signal, which are applied to the 
decoding circuits 262. 264 and 266. respectively. 

The decoding circuits 254, 262, 264 and 266 decode the encoded data inputted thereto, respectively. The 
5 output of the decoding circuit 254 is the LL signal. The SD Of A conversion circuit 268 converts the output of 
the decoding circuit 254 to an analog signal. The output of the SD D/A conversion circuit 268 Is an analog video 
signal having the number of scan lines of 525 and the frame frequency of 30 Hz and it can be displayed as an 
Image by an Image display device of the ordinary resolution. 

The reproduced LL signal and LH signal are combined atthe vertical frequency by the band synthosization 
10 filters 270 and 272 and the number of pixels In the vertical direction Is Interpolated to two times. Similarly, the 
reproduced HLsignal and HH signal are synthesized atthe vertical frequency by the band synthesization filters 
274 and 278 and the number of pixels in the vertical direction Is interpolated to two times. The synthesized 
signals are combined atthe horizontal frequency by the band synthealzation filters 276 and 2B0 and the number 
of pixels in the horizontal direction Is Interpolated to two times. 
13 By those syntheslzation processes, the digital high resolution video signal having the number of scan lines 

of 1 .050 and the frame frequency of 30 Hz Is reproduced. The HD D/A conversion circuit 282 converts the 
reproduced digital HD signal to an analog signal. 

In the decoding apparatus shown in Fig. 10, in the no key state, the decryption circuit 256 outputs a quite 
unstable data pattern so that the output of the HD D/A conversion circuit 282 is alao unstable and an unstable 
20 pattern such as a noise image is displayed on the screen of the display device such as CRT. 

Alternatively, the image of the low resolution or a still image may be displayed on the high resolution mon- 
itor screen in the no key state. Figs. 12 and 13 show portions of block diagrams of such modified decoding 
apparatus. The like elements to those of Fig. 10 ore designated by the like numerals. 

In Fig, 12, an SD/HD conversion circuit 2S4 for converting the output of the decoding circuit 254 to the HD 
25 signal and a selection switch for selecting the output of the SD/HD conversion circuit 284 or the synthesized 
output by the band synthealzation filters 278 and 280 and supplying It to the HD D/A conversion circuit 282 
are provided. The SD/HD conversion circuit 284 is identical to the SD/HD conversion circuit 54 of Fig. 6. The 
switch 286 is normally connected to synthezied output of the band synthesizatlonf > Iters 278 and 280, and when 
no key state Is detected by the decryption circuit, it Is switched to the output of the SD/HD conversion circuit 
so 284 by the detection output Thus, in the no key state, the image can be displayed by the high resolution monitor 
although the quality of the Image is not sufficient for the high resolution monitor. 

When the encryption key signal may not bo inputted to the decryption circuit 256\ It may be possible that 
the output of the encryption key output circuit 258 is forcibly stopped or the encryption key output circuit 258 
Itself is not present. 

35 For the configuration shown in Fig. 12, the high frequency data of the band syntheslzation filters 270 - 

280 may ba reset by the detection output of the decryption circuit 256' to attain the same effect. 

In Fig. 13, a switch 282 |s provided between the synthesized output by the band syntheslzation filters 278 
and 280 and the HD D/A conversion circuit 2B2 so that in the no key state, a predetermined level is inputted 
to the HD D/A conversion circuit 282, The switch 288 normally selects the synthesized output by the band syn- 

aq thesization filters 278 and 280, and when the no key state Is detected by the decryption circuit 256, it is switched 
to the predetermined level input by the detection output In this manner, when the correct encryption key Is 
present, the high resolution video signal is outputted, but In the no key state, the predetermined level signal 
is outputted and the image corresponding to the predetermined level is displayed on the monitor screen. 
When the encryption key signal is not inputted to the decryption circuit 256*, it may be possible that the 

46 output of the encryption key output circuit is forcibly stopped or the encryption key output circuit 258 Itself is 
not present. 

For the configuration shown In Fig. 1 3, the switch 288 may not be provided and the output of the HD Dy A 
conversion circuit 2B2 may be forced to a constant level (for example, zero output) in accordance with the de- 
tection output of the no key state by the decryption circuit 44. 
so - In Figs. 12 and 13. the no key state is detected by tho decryption circuit 256 although it may be detected 
by an error detection code or error correction process. 

Embodiments of the encoding circuit and the decoding circuit used in the respective embodiments are now 
explained. 

Fig, 14 shows a block diagram of a specific embodiment of the encoding circuit 
55 The encoding circuit shown in Fig. 14 comprises a blocking circuit 301, ADCT circuit 302, a quantization 

circuit 303, a variable length encoding circuit (VLC) 304, a motion compensation circuit 305, s motion vector 
detection circuit 306. a rate control circuit 307, a local decoding circuit 308 and a buffer memory 309. 

In Fig. 14, image data to be encoded is grouped into 8x8 pixel blocks by the block forming circuit 301 

7 
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„nd thev are supplied to the DCT (discrete cosine transform) circuit 302 through the switch 310 

^ftch 3?0 1 9 periodically (for example, for each frame or every several fields) sw.tcr.ed to • termma. 

8 t0 ^SXZSSSi the termina, a. an Intra-frame or intra-fletd encod.no (intra mode) is con- 

^^rfthe intra mode, it is DCT-transformed by the DCT circuit 302 and the resulting DCT coeffic dent ^la quan- 
tized by the quantization circuit 303 and further encoded by the variable length ancodmg clrcu.t 304 and tern- 

^^^SS^oStt-n the intra mod., the switch 310 Is connected to a termina. b to conduct 

" B "nation Crcit end a de-OCT c.rcuit whj* constitute the .oca. 

decoding circuit 308. The data quantized by the quantization circuit 303 Is restored to the ong.nal image data 

^ ^J^lStSSfnSi*. numera. 314 denotes a ew.tch which .s Cosed in other than the Intra mode, 
is and numeral 316 denotes a subtracter. ... 

Stilly decoded image data refers the motion vector detected by the motion vector detection crcurt 
306 to output the corresponding block of the predetermined frame (preceding frame, succeed.ng frame or ,n- 

tofP ?I?i2lSf the motion compensation circuit 305 is subtracted by the Input image data by the subtracter 
20 316 ^ J^JJ^ * c J2"^; d by the DCT circu , t 302. the quantization circuit 303 and the variable length en- 
coding circuit 304 and It Is stored in the buffer 309. 

The motion vector detection circuit 306 compares the frame data to be ancodad with the predetermined 
referenc» frame date to produce the motion vector, and the output of the motion vector detection circuit 30B 
26 is supplied to the motion compensation circuit 305 to specify the block to be outputted by the motion compen- 

COtl0 TheSe^o 0 n 5 t'rol circuit 307 controls the quantity of encoding by switching the quantization step of the quan- 
tization circuit 303 in qccordance with an occupation rate of the encoded data in the buffer 309. 

Finally the motion vector data detected by the motion vector detection circuit 306, an encod.ng .dent.fi- 
catlon code for identifying the Intra mode and quantization step data indicating the quantisation step are added 
by an adding circuit 31 5 and It Is outputted as the encoded data. 

Fig 15 shows a specific block diagram of the decoding circuit. . 
The decoding circuit basically oparatea in the reverse manner to the encoding circuit shown in Re, 14. 
The decoding circuit shown in Fig. 15 comprises an Input buffer memory 401 . a variable length decoding 
circuit 402. a de-quantlzatlon circuit 403, a de-DCT circuit 404, a motion compensation circuit 405 and an output 

b ^ThTancoded°data sequentially read from the input buffer memory 401 is processed by the variable length 
decoding circuit 402. the de-quantization circuit 403 and the de-DCT circuit 404 and converted to the space 

area The^uantization step of the de-quantizatlon circuit 403 is determined by the quantization step data which 
Is transmitted along with the encoded data. 

Numeral 407 denotes an adder for adding the output of the de-DCT circuit 404 to the difference outputted 
from the motion compensation circuit 405. and numeral 408 denotes a switch for selecting the output of the 
de-DCT circuit 404 or the output of the adder 407. 

The switch 408 is connected to the terminal a in the intra mode by the encoding identification code detected 
by the data detection circuit, not shown, and connected to the tormina! b in other mode. 

me decoded data is temporarily stored in the output buffer memory 406 and restored to the original space 
arrangement and outputted as one-frame or one-field image data. 

As will be readily understood from the above description, in accordance with the present embodiment the 
high resolution video signal is not reproduced for those who do not have the encryption key and the reproduc- 
tion of only the low resolution video signal is permitted. The charges to the users may be discriminated between 
the display device of the low resolution and the display device of the high resolution of the some content. 

The present invention may be implemented in other various forma without departing from the spirits and 
the principal features. 

55 For example, while the image signai is divided into four frequency bands in the second embodiment, the 

present invention Is not limited thereto, 

In other worda. the foregoing description of the embodiments has been given for illustrative purpose on* 
and not to be construed ae imposing limitation In every respect. 
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The scope of the Invention is, therefore, to be determined solely by the following claims and not limited by 
the text of the specification and alterations made within the scope equivalent to the scope of the claims fall 
within the true spirit and scope of the invention. 
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Claims 

1. An Image processing apparatus comprising: 

a) input means for Inputting, an Image signal; 

b) division means for dividing the image signal inputtedfrom said Inputmeans to a plurality of frequency 
band signal groups; and 

c) encryption means for encrypting at least one of the signal groups divided by said division means. 

2. An Image processing apparatus according to Claim 1, further comprising: 
encoding meana for encoding the aignal groups divided by said division msane. 

3. An Image processing apparatus according to Claim 2. wherein said encoding means conducts block en- 
coding by using orthogonal transform. 

4. An Image processing apparatus according to Claim 2, further comprising: 
20 multiplexing means for multiplexing the encoded signal groups, 

5. An Image processing apparatus comprising; 

a) Input means for inputting an image signal; 

b) conversion means for converting the Image signal Inputted from said Input means to a plurality of 
25 Image signals of different resolutions; and 

c) encryption means for encrypting at least one of the image signals converted by said conversion 
means. 

6. An image processing apparatus according to Claim 5, further comprising: 

30 encoding means for encoding the image signals converted by said conversion means. 

7. An Image processing apparatus according to Claim 6. wherein said encoding means conducts block en- 
coding by using orthogonal transform- 

35 B. An image processing apparatus according to Claim 6, further comprising: 
multiplexing means for multiplexing the encoded image signals. 

9. An image processing apparatus for dividing an image signal into a plurality of frequency band signal 
groups and decoding the divided signal groups with at least one of the signal groups being encrypted, 
comprising; 

a) decryption means for decrypting the encrypted, signal group and 

b) syntheslzatlon means for synthesizing the signal group decrypted by said decryption means with 
other signal groups. 

10. An Imago processing apparatus according to Claim 9. wherein said signal groups are encoded and said 
image processing apparatus further comprises decoding means for decoding the encoded signal groups. 

11. An image processing apparatus according to Claim 9. wherein the output of the encrypted signal group 
is inhibited when said decryption means cannot decrypt the encrypted signal group. 

50 - 12. An image processing apparatus according to Claim 9, wherein a predetermined signal is produced in lieu 
of the encrypted signal group when said decryption means cannot decrypt the encrypted signal group. 

13. An imaoe processing apparatus for dividing an Input image signal Into a plurality of Image signals of dif- 
ferent resolutions and decoding the divided image signals with at least one of the image signals being 
55 encrypted, comprising: 

a) decryption means for decrypting the encrypted image signal; and 

b) syntheslzatlon means for synthesizing the Image signal decrypted by said decryption means with 
other image signals. 
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14 An image processing apparatus according to Claim 13, wherein sajd image signals are encoded and said 
image processing apparatus further comprises decoding means for decoding the Bncoded image signals. 

15, An image processing apparatus according to Claim 13, wherein the output of the encrypted image signal 
Is inhibited when said decryption means cannot decrypt the encrypted Image signal. 

16 An image processing apparatus according to Claim 13. wherein a predetermined signal Is produced In 
lieu of the encrypted image signal when said decryption means cannot decrypt the encrypted image sig- 
nal. 

10 17. An Image processing apparatus comprising; 

a) separation me* ns for separating input Image data into low resolution image data end one or more 
auxiliary image data for interpolating said low resolution image data; and 

b) encryption means for encrypting at least one of the auxiliary Image data. 

16 18. An Image processing apparatus according to Claim 17. further comprising: 

encoding means for encoding the image data separated by said separation means. 

19- An image processing apparatus according to Claim 17, further comprising; 

synthesizatlon means for synthesizing the image data encoded by said encoding means. 

20 

20. An image processing apparatus for separating Input image data Into low resolution image data and one 
or more auxiliary image data for interpolating said low resolution Image data and decoding the image data 
with at least one of the auxiliary image data being encrypted, comprising: 

a) decryption means for decrypting the encrypted auxiliary image data; and 
25 b) synthesizatlon means for synthesizing the low resolution image data with the auxiliary Image data. 

21, An image processing apparatus according to Claim 20, wherein said low resolution image data and said 
auxiliary image data are encoded, and said image processing apparatus further comprises decoding 
means for decoding the encoded low resolution image data and auxiliary image data. 

22, An Image processing apparatus according to Claim 20, wherein thB output of the encrypted auxiliary im- 
age data is inhibited when said decryption means cannot decrypt the encrypted Image data. 

23. An image processing apparatus according to Claim 20. wherein a predetermined signal is outputted in 
lieu of the encrypted auxiliary image data when said decryption means cannot decrypt the encrypted im- 
age data. 



so 



35 



24, An image processing apparatus comprising: 

a) separation means for separating Input Image data into low resolution imsge date and one or more 
auxiliary image data for interpolating said low resolution image data; and 
40 b) mask means for masking at least one of the auxiliary image data. 

25. An image processing apparatus according to Claim 24. further comprising: 

encoding means for encoding the image data separated by said separation means. 

45 26. An Image processing apparatus according to Claim 24, further comprising; 

synthesization means for synthesizing the Image data encoded by said encoding means. 

27. Avldeo transmission system wherein one or more auxiliary video signals are transmitted with a basic vid- 
eo signal, so as to enable reproduction of basic quality images or higher quality images, wherein the or 

so . each auxiliary signal is subjected to encryption independently of the basic signal. 

28. A record carrier or signal conveying video information, wherein images are encoded at a basic quality level 
apd a higher quality level by means of basic and auxiliary signal components, and wherein at least one 
auxiliary signal component is encrypted Independently of the basic signal component. 

55 
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